A Deep Dive into the Delta Wave: Forecasting SARS-CoV-2 Epidemic Dynamic in Poland with the pDyn Agent-Based Model (preprint)

In this work, we describe and forecast the fourth wave of the SARS-CoV-2 epidemic, driven by the Delta variant, using pDyn — a detailed epidemiological agent-based model. It is designed to explain the spatiotemporal dynamics of the SARS-CoV-2 spread across Polish society, predicting the number and locations of disease-related states for agents living in the virtual society in response to varying properties of the pathogen and the social structure and behavior. We evaluate the validity of the dynamics generated by the model, including the succession of pathogen variants, immunization dynamics, and the ratio of vaccinated individuals among confirmed cases. Additionally, we assess the model’s predictive power in estimating pandemic dynamics (peak timing, peak value, and wave length) of disease-related states (number of confirmed cases, hospitalizations, ICU hospitalizations, and deaths) both at the national level and in the highest administrative units in Poland (voivodships). When testing the model’s validity, we compared real-world data (excluding data used for calibration) to our model estimates to evaluate whether pDyn accurately reproduced the epidemic dynamics up to the simulation time (October 28, 2021). To assess the accuracy of pDyn’s predictions, we retrospectively compared simulation results with real-world data acquired after the simulation date, evaluating pDyn as a tool for predicting future epidemic spread. Our results indicate that pDyn accurately predicts and can help us better understand the mechanisms underlying the SARS-CoV-2 dynamics.

Predictive performance of multi-model ensemble forecasts of COVID-19 across European nations (preprint)

Background: Short-term forecasts of infectious disease burden can contribute to situational awareness and aid capacity planning. Based on best practice in other fields and recent insights in infectious disease epidemiology, one can maximise the predictive performance of such forecasts if multiple models are combined into an ensemble. Here we report on the performance of ensembles in predicting COVID-19 cases and deaths across Europe between 08 March 2021 and 07 March 2022. Methods: We used open-source tools to develop a public European COVID-19 Forecast Hub. We invited groups globally to contribute weekly forecasts for COVID-19 cases and deaths reported from a standardised source over the next one to four weeks. Teams submitted forecasts from March 2021 using standardised quantiles of the predictive distribution. Each week we created an ensemble forecast, where each predictive quantile was calculated as the equally-weighted average (initially the mean and then from 26th July the median) of all individual models predictive quantiles. We measured the performance of each model using the relative Weighted Interval Score (WIS), comparing models forecast accuracy relative to all other models. We retrospectively explored alternative methods for ensemble forecasts, including weighted averages based on models past predictive performance. Results: Over 52 weeks we collected and combined up to 28 forecast models for 32 countries. We found a weekly ensemble had a consistently strong performance across countries over time. Across all horizons and locations, the ensemble performed better on relative WIS than 84% of participating models forecasts of incident cases (with a total N=862), and 92% of participating models forecasts of deaths (N=746). Across a one to four week time horizon, ensemble performance declined with longer forecast periods when forecasting cases, but remained stable over four weeks for incident death forecasts. In every forecast across 32 countries, the ensemble outperformed most contributing models when forecasting either cases or deaths, frequently outperforming all of its individual component models. Among several choices of ensemble methods we found that the most influential and best choice was to use a median average of models instead of using the mean, regardless of methods of weighting component forecast models. Conclusions: Our results support the use of combining forecasts from individual models into an ensemble in order to improve predictive performance across epidemiological targets and populations during infectious disease epidemics. Our findings further suggest that median ensemble methods yield better predictive performance more than ones based on means. Our findings also highlight that forecast consumers should place more weight on incident death forecasts than incident case forecasts at forecast horizons greater than two weeks.

The efficiency of dynamic regional lockdown approach in controlling the COVID-19 epidemic. Insights from the agent-based epidemiological model for Poland (preprint)

In this work properties of the dynamic regional lockdown approach to suppress the COVID-19 epidemic spread in Poland were investigated. In particular, an agent based model was used with the aim to indicate an optimal lockdown strategy, defined here as the one which minimizes mean lockdown time over regional unit provided health service is not overwhelmed. With this approach the lockdown extent was also considered by varying restrictions between complete regional school closure and/or significant social distancing in semi-public spaces. In result, a cooperative effect was discovered in the case when closure of schools was accompanied by severe restrictions of social contacts in semi-public spaces. Moreover, the regional lockdown approach implemented here on the level of counties (units of population around 100k) proofed to be successful, that is allowed to identify optimal entrance and release thresholds for lockdown. The authors believe that until significant portion of population is vaccinated such a strategy might be applied.

Short-term forecasting of COVID-19 in Germany and Poland during the second wave - a preregistered study (preprint)

We report insights from ten weeks of collaborative COVID-19 forecasting for Germany and Poland (12 October - 19 December 2020). The study period covers the onset of the second wave in both countries, with tightening non-pharmaceutical interventions (NPIs) and subsequently a decay (Poland) or plateau and renewed increase (Germany) in reported cases. Thirteen independent teams provided probabilistic real-time forecasts of COVID-19 cases and deaths. These were reported for lead times of one to four weeks, with evaluation focused on one- and two-week horizons, which are less affected by changing NPIs. Heterogeneity between forecasts was considerable both in terms of point predictions and forecast spread. Ensemble forecasts showed good relative performance, in particular in terms of coverage, but did not clearly dominate single-model predictions. The study was preregistered and will be followed up in future phases of the pandemic.